Evaluation of a Community-Led Intervention in South London: How Much Standardization Is Possible?

It is widely recognized that public health interventions benefit from community engagement and leadership, yet there are challenges to evaluating complex, community-led interventions assuming hierarchies of evidence derived from laboratory experimentation and clinical trials. Particular challenges include, first, the inconsistency of the intervention across sites and, second, the absence of researcher control over the sampling frame and methodology. This report highlights these challenges as they played out in the evaluation of a community-organized health project in South London. The project aimed to benefit maternal mental health, health literacy, and social capital, and especially to engage local populations known to have reduced contact with statutory services. We evaluated the project using two studies with different designs, sampling frames, and methodologies. In one, the sampling frame and methodology were under community control, permitting a comparison of change in outcomes before and after participation in the project. In the other, the sampling frame and methodology were under researcher control, permitting a case-control design. The two evaluations led to different results, however: participants in the community-controlled study showed benefits, while participants in the researcher-controlled study did not. The principal conclusions are that while there are severe challenges to evaluating a community-led health intervention using a controlled design, the measurement of pre-/post-participation changes in well-defined health outcomes should typically be a minimum evaluation requirement, and confidence in attributing causation of any positive changes to participation can be increased by use of interventions in the project and in the engagement process itself that have a credible theoretical and empirical basis.

Can a Community-Led Intervention Offering Social Support and Health Education Improve Maternal Health? A Repeated Measures Evaluation of the PACT Project Run in a Socially Deprived London Borough.

Social adversity can significantly influence the wellbeing of mothers and their children. Maternal health may be improved through strengthened support networks and better health literacy. Health improvement at the population level requires optimizing of the collaboration between statutory health services, civic organizations (e.g., churches, schools), as well as community groups and parents. Two key elements in improving community engagement are co-production and community control. This study evaluated a co-produced and community-led project, PACT (Parents and Communities Together), for mothers in a deprived south London borough. The project offered social support and health education. Intended effects were improvements in mental health, health literacy, and social support, assessed by standardized measures in a pre-post design. Sixty-one mothers consented to take part in the evaluation. Significant improvements were found in mental health measures, in health literacy, for those with low literacy at baseline, and in overall and some specific aspects of social support. Satisfaction with the project was high. We found that the project engaged local populations that access statutory health services relatively less. We conclude that community-organized and community-led interventions in collaboration with statutory health services can increase accessibility and can improve mothers' mental health and other health-related outcomes.